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Abstract. The fluctuations in nonequilibrium systems are under intense theoretical and 
experimental investigation. Topical "fluctuation relations" describe symmetries of the 
statistical properties of certain observablcs, in a variety of models and phenomena. They 
have been derived in deterministic and, later, in stochastic frameworks. Other results first 
obtained for stochastic processes, and later considered in deterministic dynamics, describe 
the temporal evolution of fluctuations. The field has grown beyond expectation: research 
works and different perspectives are proposed at an ever faster pace. Indeed, understanding 
fluctuations is important for the emerging theory of nonequilibrium phenomena, as well as 
for applications, such as those of nanotechnological and biophysical interest. However, the 
links among the different approaches and the limitations of these approaches are not fully 
understood. We focus on these issues, providing: a) analysis of the theoretical models; b) 
discussion of the rigorous mathematical results; c) identification of the physical mechanisms 
underlying the validity of the theoretical predictions, for a wide range of phenomena. 
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1. Introduction 



The study of fluctuations in statistical mechanics dates back to Einstein's 1905 seminal work 
on the Brownian motion [1], in which the first fluctuation-dissipation relation was given, 
and to Einstein's 1910 paper which turned Boltzmann's entropy formula in one expression 
for the probability of a fluctuation out of an equilibrium state [2]. Of the many authors 
who continued Einstein's work, we can recall but a few. In 1927, Ornstein derived the 
fluctuation-dissipation relation for the random force acting on a Brownian particle [3]. In 
1928, Nyquist obtained a formula for the spectral densities and correlation functions of the 
thermal noise in linear electrical circuits, in terms of their impedance [4], which applies 
to mechanical systems as well. In 1931, Onsager obtained the complementary result to 
that of Nyquist: the calculation of the transport coefficients from the observation of the 
thermal fluctuations [5,6]. The fluctuation-dissipation theorem and the theory of transport 
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coefficients received great impulse in the 1950's, thanks to the works of authors such as 
Callen, Welton, R. F. Greene, [7,8], and M. S. Green and Kubo [9-12]. In 1953, Onsager 
and Machlup provided a natural generalization to fluctuation paths of Einstein's formula 
for the probability of a fluctuation value [13, 14]. In 1967, Alder and Wainwright discovered 
long time tails in the velocity autocorrelation functions, which implied the non-existence 
of the self-diffusion coefficient, in two dimensions [15]. Anomalous divergent behaviour 
of the transport coefficients was studied also by Kadanoff and Swift, for systems near a 
critical point [16]. Closely connected with the long time tails is the phenomenon of long 
range correlations in nonequilibrium steady states, which was pointed out and studied by a 
number of authors, including Cohen, Dorfman, Kirkpatrick, Oppenheim, Procaccia, Ronis, 
Spohn [17-19]. Nonequilibrium fluctuation theorems have been obtained also by Hanggi 
and Thomas [20,21]. The transient time correlation function formalism, which yields an 
exact relation between nonlinear steady state response and transient fluctuations in the 
thermodynamic fluxes, has been developed by Visscher, Dufty, Lindenfeld, Cohen, Evans 
and Morriss [22-25]. Under some differentiability conditions, Boffetta et al. and Falcioni et 
al. [26,27] obtained a fluctuation response relation, which applies to states that can be very 
far from equilibrium. Independently, Ruelle proved that those conditions are met by axiom 
A systems, and obtained the same fluctuation response relation [28]. 

This necessarily brief and incomplete account shows that the object of research has 
gradually shifted from equilibrium to nonequilibrium problems. But while the equilibrium 
theory can be considered quite satisfactory and complete, the same cannot be said of the 
nonequilibrium theory, which concerns a much wider range of phenomena. 

The 1993 paper by Evans, Cohen and Morriss [29], on the fluctuations of the entropy 
production rate of a deterministic particle system, modeling a shearing fluid, provided 
a unifying framework for a variety of nonequilibrium phenomena, under a mathematical 
expression nowadays called Fluctuation Relation (FR). Then, fluctuation relations for 
transient states were proved by Evans and Searles in 1994 [30,31], while Gallavotti and 
Cohen obtained steady state relations for systems whose dynamics can be considered to 
be Anosov, in 1995 [32,33]. The FR is one example of the few exact, general results on 
nonequilibrium systems, and extends the Green-Kubo and Onsager relations to far from 
equilibrium states [34-36]. 

The subject of the present review is the FR for deterministic particle systems, with an 
eye on open problems, and on the interplay of mathematical and physical investigations. 
The connection with FRs for stochastic processes is also discussed. Section [2] summarizes 
the history of FRs. Section [3] illustrates a class of deterministic, time reversal invariant 
models of nonequilibrium systems, relevant in the study of FRs, and reports some new 
results. Sections H] and [5] illustrate, respectively, the mathematical theory, developed for the 
phase space contraction rate, and the physical mechanisms underlying the validity of FRs 
for quantities such as the energy dissipation rate. Section [6] is devoted to the Jarzynski 
and Crooks relations and to their connection with the FRs. Sections [7] and M illustrate, 
respectively, some stochastic versions of the FRs, including the Van Zon-Cohen relation, and 
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the theory developed by Jona-Lasinio and collaborators. Section [9] describes some numerical 
and experimental tests of the FRs. Concluding remarks are made in Section [101 

1.1. Prologue 

Why focus on deterministic rather than stochastic FRs? The stochastic approach seems 
to produce easily the same results that the dynamical approach obtains with much effort. 
Kurchan says that this is the case because the stochastic description, commonly assumed to 
be a reduced (mesoscopic) representation of the "chaotic" microscopic dynamics, is free from 
the intricate fractal structures of deterministic dynamics [37]. Then, considering that the 
mathematical approach to deterministic FRs makes assumptions which, in general, cannot 
be directly verified [37], one may conclude that the stochastic approach is to be preferred 
to the deterministic one. In reality, there are various reasons to consider deterministic 
systems. For instance, fundamental issues, like irreversibility, can hardly be understood 
within the framework of the intrinsically irreversible stochastic processes [37]. Also, 
stochastic descriptions assume that averages characterize single systems. This is justified 
only if the microscopic dynamics are sufficiently "chaotic" that the average behaviour is 
established within mesoscopic time scales [38], as happens in Thermodynamics, thanks to 
the interactions among the particles, and to their very large number. However, in certain 
circumstances particles do not interact or interact more with their environment than with 
each other [39,40]; the number of particles may be small; strong external drivings may 
produce ordered phases; etc. In such cases, the local thermodynamic equilibrium is violated 
and average behaviours do not characterize single systems, they only characterize ensembles. 
Furthermore, the identification of physical observables in stochastic processes is often affected 
by ambiguities. As far as the microscopic-mesoscopic connection is concerned only a few 
models, like the Lorentz gas [41-43], have been mapped into Markov processes [44], and the 
mapping concerns the phase space, not the real space. 

Adding that certain results obtained for stochastic processes were not obvious in terms 
of reversible equations of motion (cf. Section [8] on temporal asymmetries), while results such 
as the FRs were not obvious in the stochastic description, we conclude that the deterministic 
and the stochastic approaches are both necessary to provide a unifying framework, for the 
field of nonequilibrium physics, and its applications. In this review, we mainly focus on 
deterministic FRs, but we also discuss their relations with the stochastic ones. 

We illustrate two classes of FRs, transient and steady state FRs. The transient FRs 
concern the time dependent response to external drivings of ensembles of systems, or 
ensembles of experiments, and hold under very general conditions (time reversibility suffices 
for those obtained by Evans and Searles; Hamiltonian dynamics suffices for the one derived by 
Jarzynski). These relations have interesting applications in the study of nanotechnological 
devices and of biological systems [45], and hold for arbitrarily short times. The steady 
state FRs have similar applications, but are valid only asymptotically in time, are harder 
to derive in deterministic systems, and have been rigorously obtained only for the phase 
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space contraction rate of uniformly hyperbolic dynamical systems [32,33]. Nevertheless, 
studying the mechanisms which underlie the validity of the steady state FRs for physically 
interesting observables, one understands why they hold so much more generally [46]. In 
particular, extending the ensemble derivations of the transient relations, one realizes that 
time reversibility and the decay of the autocorrelation of the energy dissipation imply the 
validity of a wide class of steady state FRs. Some decay of correlations is always needed 
to reach a steady state, and to identify the statistics generated by the evolution of a single 
system in real space, with that of an ensemble of systems in phase space. It turns out that 
the form of mixing required by the steady state FR's is minimal. This approach, which 
justifies also the physical time scales within which the steady state FRs can be verified, is 
similar to the stochastic approach, as it deals with the time evolution of probability measures 
(determined by the Liouville Equation, instead of the Master Equation). Thus, it leads quite 
easily to a number of results and relations, including the FRs. 

Like the deterministic and stochastic descriptions are complementary, the mathematical 
and physical approaches (summarized in Sections 0] and Ej) contribute differently to our 
understanding of nonequilibrium phenomena, and benefit from each other's investigations, 
even if they mostly proceed along distinct, parallel paths. For instance, the mathematical 
approach is concerned with the identification of dynamical systems which allow a rigorous 
derivation of some kind of FR, for one phase function. This approach may appear to be 
physically irrelevant, because it may proceed independently of the nature of the dynamical 
systems and of the phase functions under investigation. Indeed, the Anosov systems, whose 
phase space contraction rate obeys one FR [32,33], do not look per se physically revealing; 
they may even be considered misleading, since they conceal the true reasons for a real 
object to obey one FR. Nonetheless, intriguing physics questions have been raised by the 
mathematics, like the (still open) question of which observables and which systems of physical 
interest verify the modified FR -Eq.(|12J)- of Refs. [47,48], see e.g. [49,50]. 

On the other hand, the physical approach is concerned with understanding the 
mechanisms for which a particular observable, of one physical system, does obey a given 
FR. Thus, derivations of the FRs such as those of Refs. [46,51], which are meant to provide 
this understanding, may look mathematically uninteresting, because they rely on physical 
assumptions, which look impossible to prove. These assumptions amount to a sufficiently 
fast decay of certain correlation functions, which makes perfect physical sense, but cannot be 
mathematically established. Nevertheless, similarly to the arguments of [29] , they introduce 
an intriguing mathematical problem: to construct one dynamical system with one phase 
function, for which such a decay of correlations can be rigorously assessed. 

The mathematics and the physics still stand on very different grounds. For instance, 
the mathematically trivial transient relations, like the transient f2-FR, the Jarzynski and 
the Crooks relations, are physically very interesting: they constitute a challenge for 
experimentalists, and carry information on the physical relevance of current models of 
nonequilibrium physics. Also, they are useful in the study of nanoscale biological systems, 
in which no sufficiently general guiding principle has been so far firmly established. 
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Khinchin's viewpoint on the mathematical ergodic theory and the physical ergodic 
hypothesis [52], provides a notable analogy for how the distinct approaches to the FRs 
may prolifically interact. Sections 4 and 5 elaborate further on these issues. 

2. Concise History of the Fluctuation Relation 

In 1993, Evans, Cohen and Morriss published a seminal paper [29], on the fluctuations of 
the dissipated power, or the entropy production rate a, in macroscopic systems close to 
equilibrium. In the model of [29], this observable, later obtained from the more general 
Dissipation Function Q [51], defined in Section [5j equals the phase space contraction rate 
A [53], defined in Section [3j The authors of [29] proposed and tested the following relation: 

= e rA m 

where A and —A are averages of the dissipated power, divided by k B T, on evolution segments 
of duration r, and P T is their steady state probability. In analogy with the periodic orbit 
expansions [54,55], Eq.(TjQ) was obtained from the "Lyapunov weights" in the long r limit. 
Remarkably, Eq. ([T|), does not contain any adjustable parameter. 

In 1994, Evans and Searles obtained the firsts of a series of relations similar to Eq.([T]), 
which we call transient fi-FRs, because they concern Q [30,31,50,51,56-58], for ensembles of 
systems which evolve in time. The only requirement for the transient f2-FRs to hold is the 
reversibility of the microscopic dynamics. Because they describe the fluctuations of Q, these 
relations can be experimentally verified [59]. Evans and Searles argued that, in the long r 
limit, the transient f2-FRs become the steady state f2-FRs, as indicated by many tests, e.g. 
Refs. [47,50,57,60-67]. 

In 1995, Gallavotti and Cohen provided a mathematical justification of the Lyapunov 
weights of Ref. [29], introducing the Chaotic Hypothesis [32,33,68,69]: 

Chaotic Hypothesis: A reversible many-particle system in a stationary state can be 
regarded as a transitive Anosov system for the purpose of computing its macroscopic 
properties. 

The result was a genuine steady state FR, which we call A-FR, as it concerns the fluctuations 
of the phase space contraction rate A. This quantity is proportional to the energy dissipation 
rate of a subclass of Gaussian isoenergetic particle systems, which includes the model of [29] . 

A strong assumption as the Chaotic Hypothesis raises the question of which systems 
of practical interest are "Anosov- like" , since almost none of them is actually Anosov. The 
answer of Ref. [32,33] is that the Anosov property, in analogy with the Ergodic property, 
holds "in practice". Difficulties with the physical interpretation of the A-FR emerge because 
A, in general, does not have an obvious physical meaning, and because it is problematic, 
when not impossible, to verify the A-FR close to equilibrium, even in numerical simulations 
where A is an accessible quantity [36,57,60,61,63]. 
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In 1996, Gallavotti showed that the FR constitutes an extension to (even strongly) 
nonequilibrium systems of the Green-Kubo and Onsager relations [34]. 

The A-FR applies to dissipative systems, i.e. to systems whose phase space volumes 
on average contract. In [70], Eckmann, Pillet and Rey-Bellet studied the steady state of 
an anharmonic chain coupled to infinite thermal baths, so that the overall system is non 
dissipative. They showed that the relevant rate of entropy production is strictly positive 
and obtained heuristically a suitable FR, which was later rigorously proven by Rey-Bellet 
and Thomas [71]. 

Because fluctuations are not directly observable in macroscopic systems, but can be 
observed in small systems or small parts of macroscopic systems, a few attempts have been 
made to derive a local version of the FR [49,72-74]. This issue deserves further investigation. 

The first stochastic FR motivated by Ref. [29] was obtained by Kurchan in 1998 [75]. 
The stochastic FRs of Lebowitz and Spohn [76], of Evans and Searles [77], and of Maes [78] 
followed. The stochastic results of Van Zon and Cohen, [79,80], are particularly interesting 
for the theory of deterministic systems. The works by Bodineau and Derrida [81], and by 
Bertini, De Sole, Gabrielli, Jona-Lasinio and Landim [82] also lead to stochastic FRs. Other 
generalizations and extensions of the A-FR and f2-FRs have been produced by different 
authors, see e.g. Refs. [49,56,77,79,80,83-89]. It is impossible to mention all of them here. 
The reader is therefore referred to the cited literature for more information. 

The Jarzynski equality is a transient relation, which connects free energy differences 
between two equilibrium states to non-equilibrium processes [90]. It was obtained 
independently of the FRs in 1997. In 2000 Crooks derived an equality that combines the 
transient FR and the Jarzynski equality in just one formula [91]. Both the Jarzynski and 
the Crooks equalities concern evolving ensembles of nonequilibrium states, rather than single 
nonequilibrium stationary states. Hatano and Sasa, in 2001, produced a relation of similar 
kind [92], developing the works of Paniconi and Oono [93]. 

The picture would be completed by a review of the quantum versions of the FR, 
but we cannot elaborate also on that. On the other hand, as is often the case for the 
objects of statistical mechanics, quantum mechanics introduces technical difficulties which 
must be treated with appropriate techniques, but do not modify the conceptual framework. 
Therefore, the interested reader is referred to the existing literature, such as [85-89]. 



3. Dynamical models and equivalence of ensembles 

Let a system constituted by N classical particles, in d dimensions, be described by: 

± = G(x) ; x = (q, p) G M. C IR 2dN , (2) 

where M. is the phase space, and G is determined by the forces acting on the system and 
by the particles interactions. A dynamical quantity of interest, in the following, is the phase 
space contraction rate A, defined by 

A = -divG. (3) 
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If the dynamics are discrete, x n+ \ = F(x n ), the phase space contraction per unit time is 
given by 

\dF 



A = — log J , with J 



(4) 



dx 

the Jacobian determinant of F. For continuous time, denote by S t x, t G M, the solution 
of Eq.(j2]) with initial condition x. An observable quantity O is the time average of a phase 
function O : M -> 2R 



1 



C?(x) = lim ^ / 0(S t x)dt x G M (5) 

Computing such a limit is exceedingly complicated, in general, but in equilibrium the problem 
is commonly solved by the Ergodic Hypothesis, which states that 

6{x) = ^ J 0{y) d^{y) = {O), (6) 

for a suitable measure /i, and for /i-almost all x G .M. Similar relations hold for discrete 
time evolutions. 

Only a few systems of physical interest verify the strict mathematical statements of 
the ergodic theory, and there is no hope that a many particles system will ever explore 
its phase space as densely as suggested by Eq.flE]). Nevertheless the Ergodic Hypothesis 
is successfully applied in a very wide range of situations, because the variables of physical 
interest are but a few, and tend to constants in the large N limit (cf. chapter I of [94] 
and Ref. [52]). This means that the set of observables of interest is too small to probe 
true ergodicity, and that different, necessarily partial models of the same system may be 
equivalent in describing its limited set of physically interesting properties. Therefore, for an 
isolated system whose energy H remains within a thin shell [E,E + AE], it is justified to 
postulate that /i is the microcanonical ensemble; for a closed system in contact with a heat 
bath at given temperature, the canonical ensemble is postulated; and so on. A posteriori 
one checks whether the assumption is valid or not, and finds that these classical ensembles 
are appropriate in very many situations: they can be used in practice, for calulations of 
physically relevant quantities. In the thermodynamic limit (N becomes large at constant 
density and energy density) the different ensembles become equivalent, in the sense that the 
averages of local observables tend to the same values. 



3.1. The models 

Nonequilibrium systems in steady states appear harder to treat than equilibrium phenomena, 
thus one needs simple models, to assess various hypothesis. From this stand point, 
Nonequilibrium Molecular Dynamics (NEMD) is one large reservoir of interesting models, 
which have been successfully adopted in the study of the rheology of fluids, polymers 
in porous media, defects in crystals, friction between surfaces, atomic clusters, biological 
macromolecules, among a host of other phenomena [53,95,96]. They are not reliable if 
quantum mechanical effects are important, if the interatomic forces are too complicated or 
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insufficiently known, if the number of particles needs to be too large, or the simulations have 
to be too long; but NEMD models are otherwise quite successful in computing transport 
coefficients, and are a valid alternative to a number of experiments. In this paper, the 
following models are used: 

q; = pi/m + Q ■ F ext , 

p. = pint + V . . pext _ athp . ^ I ) 

where F ext is the external driving, coupled to the system via the constants Ci and X>j, 
pmt _ _y<| ) iJif j g conservative force due to the internal interactions among the particles, 
with interaction potential $ mt ; and % = 1, ...,N. The term a t hPi is deterministic and time 
reversible, and is needed to add or remove energy from the system, in order to reach a steady 
state [53] . It is not a physical force; it is a "synthetic" thermostat that substitutes the very 
many, practically impossible to treat, degrees of freedom of a real thermostat. 

For quantities not affected by how energy is removed from the system, the form of 
a t h is irrelevant, because susceptibilities of thermal processes are similar to susceptibilities 
of mechanical processes [53]. Therefore, driving boundaries may be efficiently replaced by 
fictitious external forces and constraints, for the purpose of computing transport coefficients, 
and ad hoc models may be devised as equivalent mechanical representations of both 
mechanical and thermal transport processes. The theory illustrated in Refs. [53, 96, 97] 
guarantees the correctness of the results obtained via Eqs. ([7]). 

The models which have been mostly used in the study of the FR are derived from Gauss' 
principle of least constraint [98,99]: 

Gauss Principle (1829): Consider N point particles of mass m^, subjected to frictionless 

(c) 

bilateral constraints (f)\ and to external forces Fj. Among all motions allowed by the 
constraints, the natural one minimizes the "curvature" 

i=l x ' i=l 



The resulting equations of motion are Hamiltonian only for holonomic constraints. The 
isokinetic (IK) constraint, which fixes the kinetic energy K = XliPi /2m, and the 
isoenergetic (IE) constraint, which fixes the internal energy Hq = K + $ mt ; are not 
holonomic. For a system in an external electric field E, with d = and T>iF ext = qE, 
the IK and the IE constraints lead to 

ath = <* IK {x) = ^ • E + ^ • F r*j preserves K , (8) 

a t h = a IE (x) = -^pJ • E preserves H , (9) 

IK 

where J = YliLi c iQii is the electric current and q the electric charge of the i-ih particle. 
Another example of Eqs. (J7]) is a popular model for shear flows called SLLOD, given by 

q.i = pi/m + ijyi , pi = Ff * - ijp yi - a th Pi , (10) 
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and 



Oith = oljk = 




Pi - IVxiVyi) 



Otth = OiiE = 




(11) 



where 7 is the shear rate in the y direction and i is the unitary vector in the x direction. 

In the above examples, o>ie is proportional to the power dissipation, divided by the 
kinetic temperature, which, in macroscopic systems in local equilibrium, is the entropy 
production rate. Because A = — div(q, p) is in turn proportional to ajE, it can similarly be 
related to the entropy production rate. However, this interpretation faces the difficultly that 
any real nonequilibrium steady state can hardly be considered isoenergetic. Indeed, it is not 
possible to control the redistribution among the internal degrees of freedom, of the energy 
given to the system by the external drivings. Hence, the direct relation between phase space 
contraction and energy dissipation appears accidental and of difficult interpretation. 

Depending on the physical property to be described, other models are used in the 
literature; like e.g. isobaric, isochoric, isoenthalpic, constant stress, etc. models. We mention 
the popular Nose-Hoover thermostat model [100-102], defined by: 



where Kq is the chosen average of the kinetic energy K(p), and r is a relaxation time. In the 
small r limit, Eqs. (fl2l approximate the IK dynamics, but are more realistic and generate 
canonical distributions, in equilibrium, as appropriate for macroscopic isothermal systems. 

3.2. Equivalence and non- equivalence of nonequilibrium ensembles 

The NEMD models have been criticized for their non-Hamiltonian structure. However, a 
Hamiltonian structure is not to be expected in systems in nonequilibrium steady states, when 
the thermostat degrees of freedom are not included [103]. Indeed, let a complete iV-particle 
model of a system and its thermostat consist of Hamiltonian equations written as 



where the subscript s refers to the N s particles of the thermostatted system, and the subscript 
r refers to the N r — N — N s particles of the reservoir. If one is solely interested in the 
dynamics of the system variables x s , then the projected dynamics will be dissipative as the 
reservoirs, on average, remove energy from the driven system. This is schematically shown 
in Figure [TJ The projected dynamics is time reversal invariant, although it does not preserve 
the volumes in its reduced spacejj] Moreover, if the time reversed evolution is allowed in 
phase space, it is also allowed in the projected space. 

Something similar happens in NEMD models, hence their non-Hamiltonian nature is 
not a hindrance, by itself. However, the fact that they are not obtained through the ideal 

X Differently, in systems of non-interacting particles, the projected dynamics remain Hamiltonian. 





(12) 




(13) 
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x(t + At) 



x(t-A t) 





x s (t-A t) 



x(t) 



x s (t + At) 



Figure 1. Evolution of a phase space volume in the total, (x s ,x r ), and projected, 
x s , phase spaces. In the (x s ,x r ) space, the dynamics is volume preserving. The 
dynamics projected on x s expands and contracts the volumes. If the backward 
evolution occurs in full phase space, so it does in the projected space. 



projection procedure implies that they must be used cum grano salis: they represent only 
certain features of nonequilibrium systems [83,97,104-107], under certain conditionsjjj 

To the best of our knowledge, Refs. [110, 111] may be considered the first works on the 
equivalence of nonequilibrium ensembles, based on NEMD models. For the equivalence of 
various thermostatted responses, see Refs. [53,97,106,112-114]. The papers [113,114] show 
that the phase space dimensionality loss, due to dissipation, is a bulk phenomenon even when 
the thermostat acts only on the boundaries [115], confirming that boundary thermostats may 
be replaced, in some circumstances, by synthetic bulk thermostats. References [107,116] also 
deal with the equivalence of deterministic thermostats. 

Nevertheless, the equality among the entropy production rate of systems subjected to 
different thermostatting mechanisms, as well as the equality of this with the corresponding 
phase space contraction rate, is a delicate question. For instance, consider the systems 
described by Eqs.([7j) with d = and constant F ext , under IK and IE constraints. To obtain 
the equivalence of their "entropy production rates", one may proceed as follows [108]: first, 
note that the ergodic hypothesis, together with Eq.®, yields 



A ik = (dN-l){a IK ) = (dN 



EN £j_ T?int \ I Pi_-T-) rpext 

i=l m ' r i \ , / Zji=1 m Ui ' 1 



+ 



(14) 



Et / \ y» EL 

for IK systems, where the bar indicates time average and the brackets phase space average. 
The constraint removes one degree of freedom, thus the kinetic temperature T is defined by 

N 2 IN 2 \ 

(dN-l)k B T^2K = Y J ^ = (X^) > ( 15 ) 

i=l \ i=l I 

§ For instance, large N s and some form of mixing produced by particles interactions is necessary for the 
fictitious forces not to dominate the behaviour of NEMD systems [40, 108]. Furthermore, not all kinds of 
particles interactions suffice to mimic thermodynamic like behaviours [109]. 
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(K is constant). Considering that the interaction forces do not do any net work, 



N 



i=l X 1 

and dividing by the volume V of the system, to compare dynamical averages with 
macroscopic quantities, one obtains: 

_ <A„> (E^^,.F-) (SL^,) 

= — = j£r = F ' (17) 

Noting that I = (j2f=i 1^ * s ^ ne P ar ^ c l e current density, one gets: 

«* = -TjT • (18) 

where the right hand side of Eq. (ll8p is formally the expression for the entropy production 
rate, a, in Irreversible Thermodynamics. In the IE case, there is no constraint on the 
momenta, hence the kinetic temperature is defined by: 

N n 2 \ 

J2^) = dNk B T > ( 19 ) 

while Eq.((9]) yields: 

/A \ /V N -Pi-V- -F ext \ /T N ^-V \ 

a IE = = (dN - 1) i ^ i=1 mV N ^ \ = (dN - 1) ( „ mV pl j ■ F ext . (20) 



For large N, if one argues that the average of the last ratio of ( 1201) can be replaced by the 
ratio of the averages -something not obvious in nonequilibrium systems- one obtains 

T T?ezt 

< 21 > 

up to terms of order 0(l/iV). Therefore, the equality of the entropy production rates, as 
well as their equivalence with the corresponding phase space contraction rates, for systems 
with different thermostatting mechanisms, cannot be taken for granted, in general, although 
for properly chosen initial conditions, (Aje) m ay coincide with (Ajk) i n the large N limit. 
We remark that, without a large number TV of interacting particles, one could not speak at 
all of entropy production. Indeed, irreversible thermodynamics requires a local equilibrium, 
in which the extensive properties are proportional to iV and depend further only on the 
temperature and on the number density n = N/V. But for large N, one could have 
o~ie = o~ik + 0(1/N), in which case one could speak of equivalence of nonequilibrium 
ensembles in the thermodynamic limit (N, V — > oo, while density and energy density tend 
to a constant). This idea has been further developed by Ruelle in [117]. 

The proper choice of the initial conditions plays a role also in the equivalence principle 
for hydrodynamics, formulated by Gallavotti [83], which concerns evolution equations like 

ii+ (u- V)u = --Vp + g + aAu , V-u = 0, (22) 
P 
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where, u is the fluid velocity field, p the fluid density, p the pressure, and g is a constant 

force. If a — v is constant, Eq.(l22l) is the Navier-Stokes (NS) equation with viscosity v. 

Gallavotti considered the case with 

, „. f \uj ■ f + uj ■ (uj ■ V)u] fix , . 

a(u,w,3 = - — 1 J J , (23) 

J (Vxw) dx. 

where w = Vxu and f = V x g, and called Eq. (1221) the Gauss-Navier-Stokes (GNS) equation. 
This equation is time reversible, and has constant enstrophy Q = j uj 2 dx. In periodic 
boundary conditions, expanding u in Fourier modes, and truncating, yields a dynamical 
system, with a certain phase space contraction rate. Gallavotti then stated the: 

Equivalence Principle. The stationary probability distributions of the NS and of the GNS 

equations are equivalent in the limit of large Reynolds number, provided Q and v are so 
related that the constant phase space contraction rate of the NS equation and the average of 
the fluctuating one of the GNS equation are equal. 

In analogy with equilibrium statistical mechanics, this principle is supposed to hold for 
local variables, and the large Reynolds number is invoked for the fluctuations of a to be fast 
on the observation time scales. Then, if the average of a equals something that depends 
on the initial state, the behaviour of the NS and the GNS evolutions should be the same. 

In Refs. [49,84], the Lyapunov spectra of the NS system, expressed by a small number 
(up to 168) of Fourier modes, were indeed found to coincide with those of the GNS under 
different constraints. This shows that the Equivalence Principle describes certain dynamical 
systems related to equations ( 1221 1231) . but it does not answer the question of its relevance 
for turbulence, which requires simulations with substantially larger numbers of modes. This 
is still quite a demanding task, in computational terms. Therefore, for the cases of Ref. [49] 
in which the principle was best verified, we have increased by only one order of magnitude 
the number of degrees of freedom, passing from 24 to 440 simulated modes. The result is 
reported in Fig. [2} where the spectra corresponding to the cases with equal estimated average 
phase space contraction rates are represented by the thick lines. The spectrum of the NS case 
has lower uncertainty, since its dynamics fluctuate less. Because there is some uncertainty in 
the calculation of (a) in the GNS system, we show, as a control test, two additional spectra 
for NS systems, with quite smaller and quite bigger v than the estimated (a). The NS 
spectra shift, decreasing with A (which is proportional to u), and in no case do they overlap 
with the GNS spectrum. Similarly to the case of thermostatted particle systems, discussed 
above, this indicates that the Equivalence Principle poses delicate questions. In particular, 
its applicability to models of turbulence deserves further investigation. 



4. The mathematical theory 

The mathematical approach of Gallavotti and Cohen, [32, 33], is meant to identify the 
context within which a relation like Eq.Q can be rigorously derived, i.e. to place on solid 
mathematical grounds the Lyapunov weights used in [29]. This approach assumes that 
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Figure 2. Lyapunov spectrum of the constant energy GNS system, approximated by 440 
Fourier modes with (a) = 0.0105 ± 0.0006 (plus symbols), and corresponding NS spectrum 
with v = 0.011 (cross symbols). For clarity, only one third of the symbols are drawn and 
the shaded regions around them correspond to the errors, which are estimated as the range 
between the highest and lowest computed value, in the last two thirds of the run. The upper 
and lower thin lines concern the NS system with v = 0.007 (solid) and v = 0.015 (dashed), 
which are well below and above (a) (error bars have the same size as for v = 0.011). 



dissipative, reversible, transitive Anosov diffeomorphisms are idealizations of nonequilibrium 
particle systems, hence that the statistical properties of Anosov and particle systems have 
some similarity. That systems evolve with discrete or continuous time, was considered a side 
issue in [32,33], as apparently confirmed by Gentile's work on Anosov flows [118]. 

We now sketch the derivation of the A-FR of [32,33]. Take a smooth compact manifold 
Ai, with a Riemann metric, and a diffeomorphism on it, S : Ai — > Ai, with Holder 
continuous first derivatives. The dynamical system (Ai,S) is Anosov if Ai is uniformly 
hyperbolic for S: i.e. there is a splitting of the tangent bundle TAt = V~ © V + , such that 
x i — ► is Holder continuous, TS V~ C V~, TS V + = V + , and 

IITS^H < C6~ n for v eV~ (24) 
HTS^H < C6- n for v e V + (25) 

for all n > and for given constants C > 0, 9 > 1. The dynamics is transitive if the stable 
and unstable manifolds are dense in M. for all x G Ai. The following holds [119]: 

Theorem (Sinai, 1968). Every transitive Anosov diffeomorphism has a Markov partition. 

A Markov partition is a subdivision of Ai in cells whose interiors are disjoint from each other, 
and whose boundaries are invariant sets constructed using the stable and unstable manifolds. 
This allows the interior of a cell to be mapped by S in the interior of other cells, and not 
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across two cells, which would include a piece of their boundary. Furthermore, partitions 
with arbitrarily small cells can be constructed. Now, let J be the Jacobian determinant of 
S, A(x) = — log J(x), and consider the dimensionless phase space contraction rate averaged 
on a trajectory segment w XjT of middle point x G A4, and duration r: 

r/2-l 

er(x) = — rr £ A (^*) (26) 

^ ' -r/2 

Let J u be the Jacobian determinant of S restricted to V + . If the system is Anosov, 
probability weights of the kind conjectured in [29] can be assigned to the cells of a finite 
Markov partition, and the probability that e T (x) falls in the interval B pjE = (p — e,p + e) 
coincides, in the limit of fine Markov partitions and long r's, with the sum of the weights 
w x>T = n T k =_r/ 2 J u (S k x)~ 1 of the cells containing the points x with e T (x) G B pt . Then, if 
Tr T (B Pt€ ) is the corresponding probability, one can write 

x,e T (x)g_B P;£ 

where M is a normalization constant. // the support of the physical measure is Ai, which 
is the case if the dissipation is not exceedingly high [120] , time reversibility guarantees that 
the support of n T is symmetric around 0, and one can consider the ratio 



— m — V ' 

where each x in the numerator has a counterpart in the denominator. Denoting by i the 
involution which replaces the initial condition of one trajectory with the initial condition of 
the reversed trajectory}]]] time reversibility yields: 

A(x) = —A(ix) , w iXT = w~l and %X,T = exp(r(A)p) (29) 

if e T (x) = p. Taking small e in B p ^ € , the division of each term in the numerator of (l28l) by 
its counterpart in the denominator approximately equals e r ^ p , which then equals the ratio 
in ff28l) . In the limit of small e, infinitely fine Markov partition and large r one obtains: 

Theorem (Gallavotti and Cohen, 1995). Let (A4,S) be dissipative, reversible and 
chaotic. Then, 

ll&tL = . (30) 

7r T (S_ p>e ) 

with an error in the argument of the exponential which can be estimated to be p, r 
independent. 

Here, dissipative means (A) > 0; reversible means iS n = S~ n i; and chaotic means that S 
can be regarded as a transitive Anosov system for the purpose of computing its statistical 

|| For instance, i may be the reversal of momenta, but is more complicated for SLLOD. 
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properties (Chaotic Hypothesis, Sec. |2j). If A can be identified with a physical observable, 
the A-FR is a statement on the physics of nonequilibrium systems. 

A quite informative derivation of the A-FR is the one based on orbital measures, given 
by Ruelle in Ref. [121], which we now summarize. Take a transitive, reversible Anosov 
diffeomorphism described above, and a Holder continuous function A : M. — > IR; there is a 
unique ergodic measure \i maximizing h(p) + J A(x)n(dx), where h is the Kolmogorov- Sinai 
entropy and \x is called the Gibbs state for A. Sinai proved that the invariant measure 
which gives the forward time statistics is the Gibbs state of A = —log J". Denoting by 
FixS" n = {x G M. : S n x = x}, the set of periodic points of period n and by a continuous 
function, the probability measure fi n defined by the averages 

M0) = Z F i^^)K=lJ u (s k x)-i (31) 

^Fixs« nfc =0 J"(S%) 1 
is invariant for S and tends weakly to \i for n — > oo: // n (0) ~~ * M^O f° r an 0- Moreover, by 
definition /i(e T ) = 1 and, because of time reversibility, one has 

JiiSx) = J(x)- 1 , e T oioS T = -e T , and J s (iSx) = J^x)" 1 (32) 

since i exchanges the stable and unstable directions. To prove the A-FR , observe first that, 
given [p, q] C IR, there are a, b > for which 

' log- M*:e r (*)€[p, g ]) < q+ b _. (33 ) 



t(A) /jl(x : e T (x) G [— q — a/r, — p + a/r\) r 
This rather sophisticated result was obtained by Ruelle relying heavily on properties of 
Anosov diffeomorphisms, hence it should hardly be generic (see also [122]). Indeed, Eq. (l33|) 
relies on Bowen's shadowing, topologically mixing, the specification property, a property 
of sums for Holder continuous functions, the expansiveness of the dynamics, the continuity 
of the splitting of the tangent bundle, and the expression of \x in terms of periodic orbits 
(c.f., Sections 3.1 to 3.8 of Ref. [121]). Furthermore, Ruelle uses a large deviation result 
for one dimensional systems with short range interactions, considering A = — log J u and 
B = — (1/(A)) log J, so that (1/t) Yll—o B{S k x) = e T (x). This result states that there is 
a real analytic and strictly concave function rj in the interval (— p*,p*) such that, for every 
other interval I which intersects {—p*,p*), the following holds 

lim ttt log// ({x : e T {x) £/}) = — sup rj(u) (34) 
r^oo r(A) (A) ue in(-p*,p*) 

where the Gibbs state of A, /i, and time reversibility have been used. Combining this with 
(|33|) . one obtains 

v 1 i fi({x:e T (x)e(p-5,p + 5)}) 

r^oo r(A) fi{{x : e T {x) e {-p - 0,-p + d)f) 
for S > and \p\ < p*. Taking this result, and the one corresponding to —p, the Gallavotti- 
Cohen fluctuation theorem is finally obtained. 

Theorem (Ruelle, 1999). Let S be a C 1+a , a > 0, Anosov diffeomorphism of the compact 
connected manifold A4, and let \x be the corresponding SRB measure. Assume reversibility, 
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C(p) = - lim - log7r r (p) = ^-(p - l) 2 + 0((p - 1) 3 F 3 ) (38) 



with involution i, and consider the dimensionless phase space contraction rate e T with respect 
to an i-invariant Riemann metric on M.. Then, there exists p* > such that the A-FR 

x^v 1 i fi{{x:e T {x)e{p-5,p + 5)}) 

p - b < hm — — log — -, r-rr- < p + 6 (36) 

r^r(A) fi{{x : e T {x) G {-p - 6, -p + 5)}) 

holds if \p\ < p* and 5 > 0. 
4-1. Consequences of the A-FR 

Taking A as the entropy production rate, Gallavotti used the A-FR to obtain Green- 
Kubo like and Onsager like relations, in the limit of small dissipation [34]. This way, 
the A-FR appears as an extension of such relations to nonequilibrium systems. Gallavotti 
assumes that the (reversibly thermostatted, continuous time) system is driven by the s fields 
F = (Fi, F 2 , F 8 ), that A vanishes for F — 0, that the phase space is bounded^ and that 

s 

A{x) = Y,F l J l {x) + O{F 2 ) , (37) 

i=l 

where Jf are the currents close to equilibrium, i.e., are linear in F. Then, the fast decay of 
the A-autocorrelation function, implied by the Anosov property, leads to 

- -l0g7T T (p) = — - 

*oo r zC/2 

where C 2 = r^ o (A(5 , '-)A(-)) T <it, and (.) T denotes the cumulant. Thus, using the A-FR, one 
obtains (A) = C2/2 + 0(F 3 ). Arbitrarily far from equilibrium, Gallavotti defines the currents 
as Ji(x) = dF i A(x), and the transport coefficients as Lij = dpj{ Ji)\F=o- The derivatives with 
respect to the parameters F require a property of differentiability of SRB measures, which 
has been proven by Ruelle in Ref. [28]. Assuming this property, the validity of the A-FR 
and using time reversibility, one can write c^r. (Jj°)|f=o = dFj{Ji)\F=o, and 

1 r°° 1 s 

- / (A(S t x)A(x)) T dt=(A) = -^(d Fj (J i ) + d Fi (-m F=0 F i F 3 , (39) 

A J ~°° A m=i 

in the limit of small F. Then, if s = 1, one recovers the Green-Kubo relations for the unique 
transport coefficient Ln. To obtain the Onsager symmetry Lij = Lji, Gallavotti extends the 
A-FR in order to consider the joint distribution of A and its derivatives. Introducing the 
dimensionless current q in a trajectory segment 

q(x) = F^r C F ' 9F ' MS ' X)dt <40) 

% Generic reversible thermostats (Ref. [34] mentions Gaussian isokinetic, Gaussian isoenergetic and Nose- 
Hoover thermostats) seem to contrast with the requirement of vanishing A at equilibrium, and with the 
boundedness of the phase space. In fact, difficulties occur in this approach, if it is applied to NEMD models 
(cf. Ref. [36] and Section 4.3 below). However, Ref. [34] is not to be interpreted as referring to concrete 
particle systems; it refers to A for hypothetical Anosov systems, provided they exist [69]. 
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and the joint distribution ir T (p, q), with corresponding large deviation functional ((p,q) = 
— lim T _ +00 - log vr T (p, q), one obtains a relation like the A-FR : 

_J_, 7Tr(P,g) i ( A~\\ 

This makes the difference (C(p,q) — C(~P> independent of q, and leads to the desired 
result, Lij = Lji, in the limit of small F. This work inspired Refs. [35,104,105]. 

The above derivations are valid if the dynamics is transitive, i.e. if the dissipation is 
not too high. It is very hard to violate this condition in a particle system [120]. However, 
this possibility has been considered in [48], where a stronger hypothesis than the Chaotic 
Hypothesis has been introduced, under the assumption that the Lyapunov exponents come 
in pairs that sum to a constant c < [123-125], except for some pair of vanishing exponents. 
In Ref. [47], Bonetto et al. had conjectured that the A-FR should generalize to the form 

log y R P % = r(A r )—-—p , 42 

apart from small errors. To understand the meaning of (D — M)/D < 1 and A r , consider 
transitive dynamics, and neglect the trivial Lyapunov exponents. Half of the remaining 
exponents are positive (A+), half are negative (A~), and can be arranged in D pairs {\f, A,^}, 
with Ci = \f + A t ~. According to the authors of [47], as the dissipation grows, the dynamics 
ceases to be transitive, some of the positive exponents become negative and lower dimensional 
attracting and repelling sets are generated. If conjugate pairing holds, i.e. if q = c for all 
% = 1,...,D, it could happen that the volume contraction along each pair of directions 
corresponding to each pair of exponents is proportional to c, and that the dimensionality of 
the attracting manifold M. r is that of M. minus the number M of pairs with two negative 
exponents. Then, A equals (D — M) /D times the contraction rate restricted to the attractor, 
A r and, if the attractor is invariant with respect to some kind of time reversal operation, the 
FR holds for A n while A must obey Eq. (142]) 1+1 

Eq. (f42|) is hard to test in particle systems, because fluctuations become less and less 
frequent as the dissipation grows. In Ref. [47], the case with (D — M)/D = 18/19 was not 
distinguishable from 1, given the achieved resolution, while the case with (D—M) / D = 17/19 
could not be tested; similar difficulties were met in [61]. An indirect confirmation of 
Eq. (j42|) . based however on new scaling assumptions, is given in [126], where a procedure 
is given to estimate finite r corrections to the steady state A-FR. Differently, Ref. [50] 
finds that the standard A-FR holds for a simple oscillator model, even in the presence of 
pairs of negative Lyapunov exponents. The theory of Refs. [47, 48] has been generalized to 
hydrodynamic models, where conjugate pairing does not hold, but fluctuations persist even 
with a substantial excess of negative Lyapunov exponents [49,83,84]. The factor (D — M) / D 
was there replaced by 

^*(Afc + \2K-1-k) 



E(Afc + \2K- 



1-fcJ 



(43) 



+ The required time reversal operation is one involution i, obeying iS l 
invariant. 
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where the 2K — 2 nontrivial Lyapunov exponents are given in decreasing order (Ai > A2... > 
A2K-2), and Y2* means summation over the pairs with one positive exponent, while is the 
summation over all the pairs. The A-FR with slope c defined by (j4"3"|) was verified in GNS 
systems truncated to few tens of modes [49]. 



4-2. Local fluctuations 

In Ref. [49] a local version of the A-FR, first proposed in [127], was also tested. One reason for 
developing local FRs is that global fluctuations are not observable in macroscopic systems. 
The local A-FR of Ref. [127] concerns an infinite chain of weakly interacting chaotic maps. 
Let Vo be a finite region of the chain centered at the origin, To > be a time interval, and 
define 

, To-l 1 T /2 

'^^w^^- p= jm £ Kv ° (sixh (44) 

1 U| U j=0 j=-T /2 

where V = Vq x T , and Ay (x) is the contribution to A given by Vq. Then, one obtains: 

n v (p) = e C(p)W\+o(\av\) ^ wi th C(p) ' ~^~ P) = 1 and \p\ < p* , (45) 

where \dV\ is the size of the boundary of V, p* > 1 and ( is analytic in p. The contribution 
of the boundary term \dV\ decreases with growing V, leading to the A-FR in the limit of 
large (compared to microscopic scales) volume Vq and long times To. 

The problem of local fluctuations, naturally leads to the possibility of extending 
Onsager-Machlup theory to nonequilibrium systems. This has been done by Gallavotti [128], 
under the assumption that the entropy production rate is proportional to A. The Onsager- 
Machlup theory [13, 14] concerns the paths of small fluctuations around equilibrium states, 
and leads to a derivation of the hydrodynamic equations for the corresponding observables, 
via the maximization of the probability of the relaxation paths, in the large system limit 
[13,14]. Gallavotti also considers the probability of temporal paths 1 1— > <p(t), for observables 
O which are either even or odd with respect to the time reversal operation, and have vanishing 
mean. The fluctuation ip, is assumed to be smooth and to vanish for large \t\, but no bound 
is placed on its size. One may then consider the probability that 0(S t x) stays close to tp, in 
the time interval [— r/2, r/2], and, in the large r limit, one may consider the large deviation 
function for A to take values close to p and for O to stay close to <p, ((p, <p) say. 

The result is that the path ip(t) and its time reversal iip(t) = ±ip(—t) (where + holds 
for even and — for odd ip) are followed with equal probability if the first path is conditioned 
to an average A equal to p and the second path to an average A equal to —p. Indeed, for 
time reversal invariant, dissipative, transitive Anosov systems, Gallavotti obtains 

CH^)-C(ft») = 1 p .> lt (46) 

p(A) 

which means that it suffices to make A behave strangely (i.e. to take values different from 
(A)), to see all observables behave equally strangely. The further developments of Ref. [129] 
excluded a direct connection of these results with the theory of Ref. [82]. 
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4-3. Applicability of the Chaotic Hypothesis 

The question arises of whether any system of physical interest verifies the Chaotic Hypothesis. 
As the FR implied by the Chaotic Hypothesis concerns the physically non-obvious A, this 
question has been little investigated. Some of the papers in which A was considered suggested 
that the steady state A-FR holds for reversible dynamical systems with one or more positive 
Lyapunov exponents [34], but also for some systems without positive exponents [130,131]. 
That A should be bounded and that the A-FR should hold only for \p\ < p*, for some p* > 0, 
was not thought to have observable consequences, at first. 

Later it was realized that the A-FR is hard, if not impossible, to verify in non-isoenergetic 
systems in steady states close to equilibrium [57, 60, 63], despite the "higher chaos" of 
equilibrium states. To explain these facts, Ref. [36] observes that the A-FR implies an 
asymmetry between positive and negative fluctuations, which is not present in equilibrium, 
hence that the A-FR for non-normalized A may hold only if its domain tends to {0} when 
the steady state tends to an equilibrium state. In the Gaussian isokinetic case, however, 
A is the sum of a dissipative term, Q, and a conservative interaction term, which may be 
singular, (cf. Eqs. l8]fTT|) . The dissipative term obeys the FR, while the conservative term 
does not, but its averages over long time intervals are small, and become negligible with 
respect to those of Q as the intervals grow [36,60]. Thus, in the long time limit the A-FR 
may hold as a consequence of the validity of the f2-FR, but its convergence times diverge as 
the steady states approach equilibrium states. Moreover, the convergence of the domain of 
the A-FR to {0} implies that the A-FR eventually describes only trivial fluctuations. This 
causes some difficulty in the derivation of the Green-Kubo relations from the A-FR, which 
requires the equilibrium limit. On the one hand, the averaging times have to be long for 
the Central Limit and the A-FR to apply, but not so long that Q = is in the tails of the 
^-probability distribution function, which are not described by the Central Limit Theorem. 
If the averaging time required by the A-FR tends to infinity, this compromise may not be 
possible. Singularities of A, in turn, make dubious the existence of the cumulants used in [34] 
to derive the Green-Kubo relations. Therefore, the physical applications of the A-FR and of 
the Chaotic Hypothesis appear problematic from this point of view. 

References [36, 132] suggested that, in IK systems, A is better suited to describe heat 
fluxes than entropy productions, hence that the A-FR has to be modified like the heat FR of 
Van Zon and Cohen for stochastic systems [133]. Indeed, for continuous time systems with 
singular A, terms of the form [Q int (S T x) — ^ int (x)]/r, with unbounded interaction potential 

affect the large deviations of A, if the probability distribution of $ mt has exponential or 
larger tails [134]. The solution of Ref. [134] consists in assuming that chaos due to uniform 
hyperbolicity may play the same role as the white noise in Ref. [79,80]. In the Gaussian 
isokinetic, or Nose-Hoover isothermal cases, one has 

q i = Pi Pi = E - d^ int - a Pi A = A®-I3V (47) 

where V is related to $ mt , and has an equilibrium (E = 0) distribution with exponentially 
decaying tails, while A^ has Gaussian tails. It is then assumed that the tails have same 
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properties when E ^ 0. Then, the average of A in a time r takes the form 

Ao r(x) = - / A(S t x)dt = AW T ( x ) + 2 [V(S T x) - V{x)\ , (46 

T .In T 



with A(°) , T (x) = - / A {0) (S t x)dt , (49) 



T 

and for large r, in some cases, one may assume that A^°\ Vf = V o S T and V, — V are 
independently distributed. This ultimately leads to [134] 

i pp*{A) poo poo 

lim - log / dA (0) / dVi / dVfe^^-W+^SlriA - A (0) ) + P(V - V f )] (50) 

r^ooT J- p *(A) JO JO 

= lim -log / rfA «VCo(A^)-|A-A(0)| ^ (51) 

r ^°° r i-p*(A> 

where (^(A^ -*) is the rate function of A^. Then, for the rate function of A one obtains 

Co(A_)-A„+A ; A < A 



C(A)= max Co(A^)-|A-A(°)| =<^ Co(A) 



A_ < A < A+ (52) 
A > A, 



Co(A + )+A + -A 

where Co( A ±) = T^- If the FR holds for A^, with |A< >| < p*{A), the A(°)-FR, one obtains 

[A ; < A < (A) 

C(A) - C(-A) = I Co(A) + A ; (A) < A < A + . (53) 
[ Co(A+) + A+ ; A > A + 

A relation similar to the heat FR of Van Zon and Cohen is thus obtained for A. The 
statement that the A^-FR holds with \p\ < p*, if A^ is bounded or decays faster than 
exponential is justified adopting Gentile's approach for Anosov flows, which reduces the flow 
to a Poincare map [118], and assuming the Chaotic Hypothesis for the resulting map. In 
particular, the dynamics may be restricted to a level surface V — V, with V < oo, so that 
the volume contraction rate, A^°\ is bounded and the terms (Vf — K) vanish. 

This scenario is supported by Gilbert's Ref. [67], for a one particle system. However, 
all other particle systems have been found to satisfy the original A-FR, suggesting that the 
singularities in the potential term may not be sufficient for the validity of the heat FR of 
Van Zon and Cohen [135]. For stochastic systems, the first indication that singularities may 
invalidate the A-FR is found in [136]; Ref. [137] suggests that the Van Zon-Cohen FR may 
have quite wide applicability, see also [138], while [139] shows some counterexample. The 
phenomenology is quite complex, as Visco explains [140], hence it is not possible at present 
to draw the limits of validity of the theory of [134]. 

The above shows that the A-FR rests on strong assumptions, which are hardly met by 
systems of physical interest, and which have no simple physical interpretation. At the same 
time, the physically more obvious steady state f2-FR is quite generally verified, and does not 
incur in the difficulties which affect the A-FR. Thus the mathematical theory raises intriguing 
questions for the physical theory: does the f2-FR hold independently of the A-FR? Which 
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are the physical mechanisms underlying the validity of the f2-FR, when it holds? It would 
also be interesting to test Eqs. (141f46l) in NEMD models, as well as in actual experiments, 
and it is desirable that Eqs. fl42ll45|[53|) be further investigated. 



5. The physical mechanisms 

In 1994, Evans and Searles obtained the first of a series of relations similar to Eq.(TjQ), for the 
Dissipation Function Q, which, in nonequilibrium states close to equilibrium can be identified 
with the entropy production rate, a = JVF ext /k B T. Here, J is the (intensive) flux due to 
the thermodynamic force F ext , V is the volume and T the kinetic temperature [30,31]. That 
relation, called transient f2-FR, is obtained under virtually no hypothesis, except for time 
reversibility; it is transient because it concerns non-invariant ensembles of systems, instead 
of the steady state. The transient f2-FR has been verified experimentally [64,65,141], and its 
conjectured extension to steady states has been validated by many tests. The Evans-Searles 
approach to the steady state f2-FR is based on the belief that the complete knowledge of 
the invariant measure implied by the Chaotic Hypothesis is not needed to understand a few 
properties of the steady state. Like thermodynamic relations are widely applicable because 
do not depend on the details of the microscopic dynamics, the observed wide applicability of 
the steady state f2-FR suggests, indeed, that it cannot depend on subtle dynamical features, 
like approximate hyperbolicity. It is therefore necessary to understand the mechanisms 
underlying the validity of the steady state Jl-FR in systems of physical interest. 

Following Ref. [46], let M. be the phase space of the system at hand, and S T : M. — > A4, 
a reversible evolution with time reversal map i. Take a probability measure dfi(T) = f(T)dT 
on M., and let the observable O : M. — > IR be odd with respect to time reversal i.e., 
0{iT) = —0(T). Denote its time averages by 

e> t0)t0+T (r) = -ew(r) = - f° +T o(s s v)ds . (54) 

For a density / even with respect to time reversal, i.e. satisfying f(iT) = f(T), define the 
Dissipation Function as 



«<r) = -Aiog/ 



• f + A(r), so that fi t0 , t0+T (r) = i 

r 



T 



f(S t0 T) 

/(s , *o+ r r) 



In , + At ,t„- 



(55) 



Note that, for a compact phase space, the uniform density f(T) = implies Q = A. 

However, Q equals the dissipated power, divided by the kinetic temperature, in bulk 
thermostatted systems, like those of Eqs.(Cj), only if / is the equilibrium probability density 
for the given system [46], and only in special circumstances does this imply f(T) = 
That the logarithmic term exists in ( 155]) has been called ergodic consistency [51], a condition 
met if / > in all regions visited by the trajectories S'T. 

For 5 > 0, let Aj = (A - 5, A + 5) and Aj = (-A -5, -A + 5), and let E(0 G (a, b)) 
be the set of points Y such that 0(T) G (a, b). Then, E(Q 0tT G Aj) = iS T E(Q 0)T G Af), and 
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the transformation T = iS T X has Jacobian 
dY 



exp ( - / A(S s X)ds ) = e~ A °^ A > , (56) 

Then, introducing (C)q eA + as the average of O according to [i, under the condition that 
f2o,T G Af, and taking the dissipation function as the observable, Oo, T = Qo, T , one may write 

_ lE { n , T eAj)f( T ) dT / o^H ^ 



z.e., 



^(E(g , T G A+)) = [A+e( i )A , T)]T f58) 

with e an error term due to the finiteness of 5, such that \e(5, A, r)| < 5. We call (158|) the 
transient fl-FK. The transient O-FR refers to the non-invariant probability measure fi of 
density /; it is remarkable that time reversibility is the only ingredient of its derivation. To 
obtain the steady state f2-FR, let averaging begin at time to and consider 

v(E(O toM)+T G At)) 



»(E(O t0tt0+r G AJ)) ' 
Taking t — r + 2t , the transformation T = iS t W and some algebra yield 
fi(E(O t0it0+T G At)) , , n u _! 



(59) 



(e X p(-Q 0)t ))o t0ito+r ^+ , (60) 



,[A+e{8,t ,A,T)]T /g-no.tQ-^to+r^to + rV 1 (g]\ 



fi(E(O t0 , t0+T G AJ)) 
and for Ot ,t +r — ^t ,t +r 

fjjE^o+r e At)) 

v(E(n t0>t0+T g aj)) 

where \e(S, to, A,t)\ < 5 is due to the finiteness of Ag ■ 

Having fixed r > and the tolerance 5 > 0, we say that A lies in the domain T> 
of the steady state f2-FR, if there exists t > such that (j,(E(ttt 0t t + T £ At)) > anc ^ 
fj,(E(Q to>to+T G )) > for all t > t. In other words, A G V if positive and negative 
fluctuations of size A have positive probability in the steady state. Using fi(E) = n to (S to E), 
where E is a subset of Ai, and fit is the evolved measure up to time to, with density ft , 
some algebra yields the 0-FR: 

ft „(g(Q,, 6 .4.+)) = AE(0^, + r 6 = 

ft„(B(Oo.x € A;)) p,(E(O UMT tA- s )) Vy °''"<W^+ ) 
For O t(h t +T = ^t ,to+r; taking the logarithm and dividing by r produces: 

1 /i f0 (E(n , T G A+)) _ 1 / _n 0>io _n (0+r , 2to+T x (63) 
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If fi to tends to a steady state ^ when t — > oo, Eq.(|63l) should change from a statement on 
the ensemble f to , to a statement on the statistics generated by a single typical trajectory. To 
be of practical use, however, this statement requires that the logarithm of the conditional 
average, divided by r, M(A, 5, t , r) say, be controllable in Eq.( l63l . For instance, if it can be 
made negligible, e.g. letting 5 be small and r grow after the t — > oo limit has been taken, 
as in the case of the A-FR, one would have the 

Steady State O-FR. For any tolerance 7 > and A £ D, there are sufficiently small 5 > 
and large r, such that 

,4- 7 <l ln M£(g.,^)) 

holds. 

As in the case of the A-FR, the domain T> would be model dependent, and its expression 
could rest on non-trivial dynamical relations [68]. This requires some assumption. Indeed, 
the growth of t could make M(A, 5, t , r) diverge (as in properly devised examples [46]). If 
lim^oo \M(A,S,to,T)\ is bounded by some finite M(A,5,t), lim^oo M(A, 5, r) could still 
exceed the value of 7. The first difficulty is simply solved by the observation that the 
divergence of M(A, 8, to,r) implies a divergence of the left hand side of Eq. (1631) . which in 
turn means that one of its two probabilities vanish, i.e. that A ^ T>. If P is empty, the 
steady state f2-FR is of no interest, because there are no fluctuations in the steady state. 

Therefore, let us assume that A £ T>, and observe that the conservation of probability 
yields the relation 

(e~ n °'») = l, for every s £ M , (65) 

first derived by Morriss and Evans (cf. [53], pp. 198-202). Then, one possibility that can be 
considered is that the ^-autocorrelation time vanishes. In that case, one can write: 

1 = ( e -no,.-n.,i) = ( e -no,.) ( e -n.,*) j ( e -°».*) = 1 , foralls,t, (66) 

hence 

Then, the logarithmic correction term in (I6"3"|) identically vanishes for all to, r, and the J7-FR 
is verified at all r > 0. Of course, this idealized situation does not need to be realized, but 
tests performed on molecular dynamics systems [142] indicate that the typical situation is 
not dissimilar from this; typically, there exists a constant K, such that 

< — < / e -n ,t -n t0+T , 2t0+T \ < K / 6g N 

As a matter of fact, the de-correlation or Maxwell time, tM, expresses a physical property 
of the system, thus it does not depend on t or r, and depends only mildly on the external 
field [usually, t M (F e ) = ^m(O) +0(F e 2 )]. Its order of magnitude is that of the mean free time. 
If r ^> tM, the boundary terms Q to -t M ,t an d flt + T ,t +T+t M are typically small compared 
to Q to j + T , unless some singularity of Q occurs within (to — t M ,t ) or (£ + t, t + r + £ M ). 
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However, similar events may equally occur in the intervals (0, to) and (to + t, 2to + t), hence 
-tM,to anc ^ &>t +T,t +T+t M are expected to contribute only a fraction of order 0(tjv//r) to 
the arguments of the exponentials in the conditional average. Therefore, one can write 

/g-^O.to . e -^i +r,2t + r\_ ^ ( e - Q 0,t -t M . „ -^t„ +r + i M ,2t () + r \ _ 

\ /n iQ , t0+T eA+ \ /n to , to+T gyi+ 

~ ^ e ~ n o,t -i M . e -n to+T +t M ,2t +T^ 

with an accuracy which improves with growing to and r, because £m is fixed. If these scenarios 
are realized, Eq. fl68|) follows and M(A, 5, t , r) vanishes as 1/r, with a characteristic scale of 
order 0{tM)- In summary, the steady state f2-FR holds under the following conditions. 

Conditions: 

1. the dynamics is time reversal invariant. 

2. fi t tends to ji^ for t — > oo. 

3. Eg. / fffgj) is satisfied with K > 0, for A G T>, if r and t are sufficiently larger than t^- 

Condition fl68l) can actually be weakened, but the decay of the ^-autocorrelations 
characterizes the convergence to a steady state, and is very widely verified. Therefore, 
the validity of Eq. (l68l) . and not a weaker condition, explains why the steady state f2-FR 
holds for the particle systems so far investigated. The above derivation of the steady state 
f2-FR, under Conditions 1, 2 and 3, will not only answer the physics questions, but will also 
be mathematically rigorous, if it will be proven that one (possibly physically uninteresting) 
dynamical system satisfies them. 

Various other relations can now be obtained [46]. For instance, any odd O, any 5 > 0, 
any to and any r yield 

<exp(- n „,)> s /^(go^W))) 

\ m °.'»o, ,« 0+T €<-j,s) ^ E fp e (-e,5))) ' 



which, in the 5 — ► oo limit, produces the normalization property (1651) . The Dissipation 
relation 

(0) t = f ds(Q(0)O(s)) (71) 
Jo 

is another direct consequence of the approach followed in this section [143]. 
5.1. Green-Kubo relations 

A consistency check of the present theory is afforded by the derivation of the Green-Kubo 
relations based on the fi-FR [36]. Differently from Ref. [34], which deals with time- 
asymptotic quantities, this derivation stresses the role of the physical time scales. To be 
concrete, take a Nose-Hoover thermostatted system, whose equilibrium state is the extended 
canonical density 

e -p(H Q +Qa 2 /2) 
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where Q = 2Kqt and Hq is the internal energy [53]. This yields 



f c (a) = J dxf c (x, «) = y ^ exp [-(3Qa 2 /2] (73) 

Therefore, the distribution of is Gaussian in equilibrium, and near equilibrium it can be 
assumed to remain such, around its mean, for large t (CLT). To use the FR together with 
the CLT, the values A and —A must be a small number of standard deviations away from 
(Q). In [57] it was proven that 

ta Jt (F e ) =2L(F e )k B T/V + 0((F e ) 2 /tN) , 

where 



L(F e ) = PV / dt{(J(t) - (J) Fe )((m - (-J)fJ) 







F e is the external field, (-)jr e is the phase space average at field F e and £(0) = lim^^o L(F e ) 
is the corresponding linear transport coefficient. When t grows, A = gets more and 
more standard deviations away from (O), which is 0(F 2 ), for small F e , while the standard 
deviation tends to a positive constant, since that of a tends to 1/ V PQ. Assume for simplicity 
that the variance of Qo jt {F e ) is monotonic in F e at fixed t, and in t at fixed F e . Then, there 
is tcr(F e , A) such that the variance is sufficiently large when t < t a (F e , A). At the same time, 
t has to be larger than a given t$(F ei A) for the steady state f2-FR to apply to the values 
A and —A, with accuracy 5. Assume that also ts(F e ,A) is monotonic in F e . To derive the 
Green-Kubo relations, one then needs ts(F e , A) <t < t a (F e , A) for F e — > 0, which is possible 
because the distribution tends to a Gaussian centered in zero, when F e tends to zero and t 
is fixed. The result is: 
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(fl> = or L(0) = lim = f3V I dt (J(0)J(t)) Fe=0 . (74) 

5.2. Discussion 

The analysis of this section shows that the steady state f2-FR and its consequences can be 
obtained only from time reversibility and from the ^-autocorrelation decay. These are the 
physical mechanisms underlying the validity of the steady state f2-FR and, indeed, they 
correctly identify the relevant time scales. From a purely mathematical point of view, the 
decay of the ^-autocorrelation could be relaxedjf] but is needed for the convergence to a 
steady state. Therefore, the systems that verify the steady state f2-FR do not need to have 
any (even approximate) Anosov structure. At the same time, the above analysis does not 
identify the class of dynamical systems which enjoy the required ^-autocorrelation decay, as 
needed to make rigorous the above derivation of the steady state f2-FR. However, this does 
not impair our understanding of the physics of the steady state f2-FR, while the explicit 
construction of artificial models verifying (168]) is not necessarily physically revealing. 



* It suffices that the to — > oo limit of the conditional average of Eq. ([63|) grows less than exponentially fast, 
with r, or that its exponential growth has a rate smaller than S. 
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How can the above analysis be reconciled with axiom C systems, and their modified 
A-FR, Eg. (142 j) . introduced in Refs. [47,48]? Axiom C systems, indeed, enjoy a strong decay 
of correlations and, although there are no particle systems known to be of their kind, they 
can be abstractly conceived. Furthermore, modified FRs have been observed to hold for 
some observables, in particular dynamical systems [49]. The answer is that the decay of 
correlations of axiom C systems does not imply the decay required here: the first concerns 
all observables, and is referred to the invariant measure; the second concerns only Q, and 
is referred to the initial measure [46]. Therefore, certain dynamics may enjoy a decay of 
correlations with respect to p^, while they do not with respect to p, and no contradiction 
arises. What happens, in general, is not known. In Ref. [46], Appendix 2, the behaviour of 
M(A, 5, to, t) has been explicitly computed for the isokinetic particle in free space, proposed 
in Ref. [144]. It was found that M diverges, hence that it does not verify (1681) . and that the 
f2-FR does not apply, in agreement with the fact that the steady state of that system has no 
fluctuations. The study of more general cases is desired. It is also desired that the physical 
meaning of condition (1681) be better understood. Indeed, close to equilibrium, the decay 
of correlations with respect to the equilibrium measure amounts to the standard condition, 
required by the Green-Kubo theory, for the existence of the transport coefficients. Far from 
equilibrium, it needs to be understood. 

Given that Eq. (l63|) is an exact result, various mathematical questions arise. Can one find 
dynamical systems and functions of phase for which Eq. (j68l) holds? How does M(A, 5, to, r) 
behave in axiom C systems, in general? What happens with the steady state fluctuations of 
Q, if Q is bounded? 

6. Work relations: Jarzynski and Crooks 

Consider a finite particle system, in equilibrium with a much larger system, which constitutes 
a heat bath at temperature T. Assume that the overall system is described by a Hamiltonian 
of the form 



where x and y denote the positions and momenta of the particles of, respectively, the system 
of interest and of the bath, hi represents the interaction between system and bath, and A 
is an externally controllable parameter. This system can be driven away from equilibrium, 
performing work W on it, by acting on A. Let A(0) = A and A(r) = B be the initial and final 
values of A, for a given evolution protocol X(t). Suppose the process is repeated very many 
times to build the statistics of the work done, varying A from A to B always in the same 
manner. Let p be the PDF of the externally performed work. This is not the thermodynamic 
work done on the system, if the process is not performed quasi statically [145], but is always 
a measurable quantity. The Jarzynski Equality predicts that [90]: 



H{T- A) = H{x- A) + H E {y) + K(x, y) 



(75) 



{e- pw ) A ^ B = jdW p(W)e 



-PW _ e -(3[F(B)~F(A)] 



(76) 
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where (3 = l/k B T, and [F(B) — F(A)] is the free energy difference between the initial 
equilibrium state, with A = A and the equilibrium state which is eventually reached for 
A = B. The average (e~ l3W )A^ B is the average over all works done in varying A from A 
to B. While the process always begins in the equilibrium state corresponding to A = A, 
the system does not need to be in equilibrium when A reaches the value B. However, the 
equilibrium state with A = B exists and is unique, hence F(B) is well defined. Equation 
(I76p is supposed to hold whichever protocol one follows to change A from A to B, hence also 
arbitrarily far from equilibrium (large A); therefore the presence of the equilibrium quantities 
F(A) and F(B) in Eq.( 176l) is remarkable. From the thermodynamic point of view, one 
observes that the externally measured work does not need to coincide with the internal work 
(which would not differ from experiment to experiment, if performed quasistatically). From 
an operational point of view, it does not matter whether the system is in local equilibrium 
or not: certain forces are applied, certain motions are registered, hence certain works are 
recorded. The Jarzynski equality is a transient relation and, similarly to the transient Q- 
FR, rests on minimal conditions on the microscopic dynamics. It is also consistent with the 
second law of thermodynamics, since it yields 

(PW)a-+b > P \nB) - F{A)\ (77) 

because In ($) > (ln$) for positive observables $. 

Similarly, computing the ratio of the probability that the work done in the forward 
transformation is W, to the probability that it is —W in the B to A transformation, with 
reversed protocol —A, produces the Crooks Relation [91]: 

Pa~+b(W = a) -p[F(B)-F(A)] p a 



y_ — -P[*\B)-1<\A)\ p a ( 7 o\ 

P B ^A(W = -a) 

The Crooks Relation, leads to the Jarzynski Equality, by a simple integration: 

(z~ PW )a^b = j p A-> B {W = a)e- a da = e -mm-F(A)] j p B ^ W = _ a)da (79) 

= e -mB)-F(A)] (80) 

These results and the f2-FR are connected. In the first place, the transient f2-FR may be 
applied to the protocols of the Jarzynski Equality and of the Crooks Relation, [132] . Then, let 
j a and Jb be the canonical distributions at same inverse temperature f3 for the Hamiltonians 
Ha and Hb of the equilibrium states A and B respectively. The corresponding Helmholtz 
free energies are Fi = —k B T\n J dx exp[—Hi(x)/k B T] for i — A,B. For simplicity, let A 
go from A to B in a time r, with rate A = 1/r, and from B to A with rate A = — 1/r. 
Correspondingly, a thermostatted evolution may be defined by 

A = ± i 

T 

<9if(q,p;A) . <9if(q,p;A) . j 1, i = l,...,N w 

q = 7^ ; P = 7^ Sia(x)p ; S> = { n . ^ Ar 
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where the thermostat acts only on N w particles (the walls of the system), to fix their kinetic 
temperature and mimic a heat bath. Then, the work performed by the external forces is 
given by (3W = /3[Hb — — A 0)T . If A and B are the same equilibrium state, the fi-FR 
applies directly, and the Jarzynski equality is an immediate consequence of the fi-FR because 
the f2-FR implies 

{e~ m ) = j P(W)e~P w dW j dWP(-W) = 1 . (82) 

The f2-FR, the Jarzynski Equality and the Crooks Relation do not have same range of 
applicability, the Crooks Relation being the most general for canonical ensembles [132]. It is 
remarkable how they connect equilibrium to nonequilibrium properties of physical systems; 
their interest is bound to grow with our understanding of microscopic systems, particularly 
in nanotechnology and biophysics [45]. One reason for considering NEMD models in this 
context, is that they afford heat baths which are not affected by the transformation processes 
during which work is done on the system of interest. Differently, finite Hamiltonian reservoirs 
are not guaranteed to be as isothermal as required. Although the effect of the work done 
may be negligible on averages, if the reservoirs are large, its influence on fluctuations could 
be sizeable, especially in particular circumstances, like around phase transitions. Therefore, 
that different approaches agree where appropriate, strengthens all results. 



7. Stochastic systems and the Van Zon - Cohen extended FR 

The first stochastic FR was derived by Kurchan, who obtained a modified detailed balance 
property for Langevin processes of finite systems, and a FR for the entropy production, 
under a few assumptions, like the boundedness of the potentials [75]. In 1999, Lebowitz and 
Spohn [76] extended Kurchan's results to generic Markov processes: under the assumption 
that local detailed balance is attained, they showed that the Gibbs entropy variation is 
related to the action functional that satisfies the FR. This suggests that in Markov processes 
the Gibbs entropy variation plays the role of the phase space contraction. In Ref . [78] , Maes 
obtained a large deviation principle for discrete space-time Gibbs measures, leading to a FR 
for a kind of Gibbs entropy variation in time discrete lattice systems. These results can be 
seen as a generalization of the A-FR and of its stochastic versions, since stochastic dynamics 
and thermostatted systems satisfying the chaotic hypothesis are examples of systems with 
space-time Gibbs measures. 

In 2002, Farago pointed out that singularities may cause difficulties in the conventional 
use of stochastic FRs [136]. In the same year, Wang et.al. reported the experimental 
verification of an integrated version of the f2-FR for colloidal particles dragged through water, 
by a moving optical trap [59]. This experiment may be modeled through an overdamped 
Langevin process, describing a Brownian particle, dragged in a liquid by a moving harmonic 
potential with a constant velocity v* [79,80, 136, 137, 146, 147]: 

*& = -(x(t)-x*(t)) + at). (83) 
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Here x(t) is the position of the particle at time t, x*(t) = v*t the position of the minimum 
of the potential, £(t) is a white noise term representing the fluctuating force the fluid exerts 
on the particle, and k%T = 1. Then, the work done in a time r is 

W T = v* [ [-(x(t) - x*{t)]dt . (84) 
Jo 

Analyzing the results of [59] from this point of view, Van Zon and Cohen [79,80] considered 
separately the dissipated energy, or the heat Q T , and the potential energy of the Brownian 
particle AU T , and 

W T = Q T + AU T . (85) 

In [133], Van Zon and Cohen showed that, in a comoving frame, Eq. ( 183|) reduces to a 
standard Ornstein-Uhlenbeck process and thus, the stationary probability distribution and 
Green's function are Gaussian in the particle's position. Since the total work is linear in the 
particle's position, W T is Gaussian as well. Because of this and of Eq. (1841) . the variance of 
transient fluctuations of W T equals 2(W T ), and the total work satisfies the transient FR. In 
the r — > oo limit, the variance of W T remains twice its mean, hence the total work satisfies 
the steady state FR. 

Van Zon and Cohen clarified that the experiment of [59] concerned the total work, and 
that the PDF of the potential energy is exponential at equilibrium, P(A£7) ~ exp(AU), 
and is expected to remain exponential away from equilibrium. Therefore, while the small 
fluctuations of heat are expected to coincide with those of the total work, since the 
contribution of the potential energy is only 0(1), large heat fluctuations are more likely 
to be due to a large fluctuation of the potential energy. 

To summarize the derivations of Ref. [80], consider the harmonic potential V(x,t) = 
^\x(t) — x*(t)\ 2 in Eq. fl85l) . Then the heat Q T is nonlinear in the particle's position, hence 
its PDF needs not be Gaussian. Its Fourier transform is 

POO 

P T (q) = / dQ T e^P T {Q T ) . (86) 



Writing P T (Q T ) in terms of the joint distribution of the work W T and of the positions 
x(0),x(t), one obtains 

exp \w (z - q) [t - j ' 



PM = [1 + (1 - e -^)<fl3/2 ' (87) 

where w = (W T )/r is the rate of work done in the system, and (•) is the steady state average. 
Anti-transforming P T (q), one considers the heat fluctuation function 



frip) = — In 

WT 



P T {pwr) 



Pr(- P wr)\ ' (88) 

where p = Q T f (Q T ) and (Q T ) = (W T ) — (AU T ) = wr, since (AU T ) = 0, in the steady state. 
To obtain an asymptotic analytical expression of Eq. (1881) . consider the quantity 

e(A) ee lira - — (e~ XQT ) , (89) 

r^oo WT 
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and, for large r, 

P T (Q T ) ~ e -^re(Q T / W r) ? ^ 

where e(p) = max^} [e(A) — Xp] is the Legendre transform of e(A). As Lebowitz and Spohn 
proved for a class of stochastic models [76], if the relation 

e(A)=e(l-A) (91) 

is satisfied, then the conventional steady state FR holds: lim^oo f T (p) = p (cf. Eqs. (I88| 1901 
I9TT) ). Analytically continuing P T to imaginary arguments, one gets (e~ x ® T ) = P T (i\), i.e. 

_ ex P [~ wX ^ ~ A) {r + }] 
(e T) ~ [i_(i_ e-2-)A 2 ] 3 /2 ' (92) 

which is singular for A = ±(1 — e~ 2r )~ 1 ^ 2 . Using Eqs. ( 1891) and ( l92i) and taking the limit 
r — > oo, the singularities move to ±1, and Eq. (!9T|) is satisfied for |A| < 1. For |A| > 1, the 
integral in Eq. (1861) diverges, because of the exponential tails of P T (Q T ). Thus, substituting 
in e(p) and Eq. fl90l) . one obtains 

{p for < p < 1 

p - (p - l) 2 /4 for 1 < p < 3 where f T (-p) = -f T (p) , (93) 
2 for p > 3 

i.e. the fluctuations of heat smaller than (Q T ) satisfy the conventional FR, like those of W T , 
while larger heat fluctuations satisfy the modified relation ( 1931) . 

These results do not contradict those of Ref. [76], because Q T lives in an infinite 
state space, due to the unboundness of the potential, while Ref. [76] only concerns finite 
state spaces. Therefore, Q T is affected by boundary terms which cannot be neglected and 
which distinguish its behaviour from that of W T [138]. As discussed in Section 4, a similar 
phenomenon may concern A, in deterministic systems [36,134]. Therefore, one may argue 
that A plays the role of heat [148]. Baiesi et al. generalize the results of [79,80] considering 
a Langevin process with general confinement potential and motion of the minimum of the 
potential, x* [137]. They find necessary conditions on the potential V and on its motion x*(t), 
for W T to satisfy the steady state FR, namely: a) x* must be even in time (x*(t) = x*(—t)), 
or b) it must be odd (x*(t) = —x*(—t)) and V must be even in space (V(x,t) = V(— x, t)). 
Under these conditions, they obtain a generalization of Eq. (1931) for the fluctuations of 
heat. In particular, numerical test shows that for x* moving at constant velocity and non- 
symmetric V's, W T does not satisfy the steady state FR [137]. Similar observations are 
reported in [149]. 

The question of the validity of the extended FR of [79,80] has been addressed in other 
papers, like Ref. [138], where the extended FR is verified on a granular system. Differently, 
Ref. [139] shows that the extended FR does not hold in the partially asymmetric zero-range 
process with open boundaries. Various other studies have recently dealt with the statistical 
properties of Brownian particles and Langevin processes, like Refs. [37,92,93,140,150-153]. 
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8. Temporal asymmetry of fluctuations 



References [82, 154, 155] propose extensions of the Onsager-Machhrp theory [13, 14] to the 
large fluctuations of physical systems in nonequilibrium steady states, from which stochastic 
FRs can be obtained. For density-like observables of stochastic processes describing 
nonequilibrium systems in local thermodynamic equilibrium, the theory predicts temporal 
asymmetries in the corresponding fluctuation- relaxation paths (FRPs). 

For a class of stochastic lattice gases, which admit the hydrodynamic description 
1 



d t g = V 



2 D(g)Vg 



V(g) , g = g(u,t) , (94) 



where g is the vector of macroscopic observables, u is the macroscopic space variable, t is 
the macroscopic time, D is the Onsager diffusion matrix, let g be the steady state, with the 
given boundary conditions. Then, Refs. [154, 155] proves that the spontaneous fluctuations 
out of a steady state, are governed by a certain adjoint hydrodynamic equation: 

d t g = V* (q) , (95) 

with same boundary conditions. This is supposed to hold much more generally; namely, 
whenever the following holds [154,155]: 

Assumptions: 1) The mesoscopic evolution is given by a Markov process X t , which 
represents the configuration of the system at time t. The nonequilibrium steady state is 
described by a probability measure P st over the trajectories of X t ; 

2) the fields g obeying Eq. ft94\ ) constitute the local thermodynamic variables, and the steady 
state under the given boundary conditions is unique; 

3) Denoting by 9 the time inversion operator defined by 9X t = X^ t , the probability measure 
P* t , describing the evolution of the time reversed process X? , and P s t are related by 

p; t {x* t =<p t ,te M 2 ]) = P st (x t = <p_ t ,t e [-t 2 , -tj). (96) 

If L is the generator of X t , the adjoint dynamics is generated by the adjoint (with respect to 
the invariant measure \i) operator L* , which admits the adjoint hydrodynamics (G?5|) ; 

4) The measure P st admits a large deviation principle describing the fluctuations of g. 

This is the mesoscopic evolution, which is a reduced, or coarse grained, description of 
underlying deterministic dynamics. It implies that spontaneous macroscopic fluctuations out 
of a nonequilibrium steady state most likely follow a trajectory which is the time reversal of 
the relaxation path, according to the adjoint hydrodynamics, i.e. 

d t g = V*(g)=V(g)-2A, (97) 

where V can be decomposed as 

V(g) = l-V ■ ( X (g)V 6 -f) + A (98) 



2 V. Sg 

and A is a vector field orthogonal to the thermodynamic force SS/Sg. Thus A does not 
contribute to the entropy production. In the limit of small fluctuations, and small differences 
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in the chemical potentials at the boundaries, Onsager's theory is recovered, because A is a 
higher order term. 

Although the stochastic behaviour should be a coarser description of the deterministic 
one, at present the gap between the theory of [154, 155] and the behaviour of systems such 
as the NEMD models does not seem to be bridgeable in rigorous terms. Thus, one wonders 
whether the predictions of Refs. [82, 154, 155] may be verified in reversible deterministic 
particle systems. In particular, are the corresponding FRPs asymmetric in time? This 
is important, in order to understand how common the asymmetric behaviour might be 
in nonequilibrium phenomena. Also, the temporal asymmetry of fluctuations has some 
bearing on the question of how macroscopic irreversibility relates to the reversible microscopic 
dynamics [156], a question which cannot be addressed investigating intrinsically irreversible 
stochastic systems. Therefore, the stochastic approach needs to be complemented by the 
deterministic one. In Ref. [157], no temporal asymmetry was detected in the nonequilibrium 
Lorentz gas; while in Refs. [158-160], temporal asymmetries were found in the FRPs of the 
nonequilibrium FPU model of [66], and of the SLLOD model. 

The origin of the temporal asymmetry may be heuristically understood considering the 
macroscopic deterministic (irreversible) dynamics described by 

Q = V{q) , (99) 

on A4 C IR n , where D is a vector field with a unique attracting fixed point g G M. 
[157-159]. This is compatible with microscopically reversible dynamics, in which case g 
has a repelling counterpart g. The n components of g may represent the values taken by 
a scalar thermodynamic observable on the n different sites of a spatially discrete system. 
Let the local mesoscopic dynamics be a perturbation of Eq.( |99l) . with a Gaussian noise 
of covariance (t) £j (£')) = KijS (t — t') and mean (£(£)) = 0, where K is a symmetric, 
positive definite matrix: 

q = V(q)+£. (100) 

This allows different evolutions between one initial state gi = g (£«) and one later state 
Qf — Q(tf)- The different paths connecting g^ to gj occur with different probabilities, 
P oc exp (—/path), and, Eq.( l99~i) can be obtained from the minimization of the terms 

I path (2) = l r (g-V, g-V) dt , (101) 

j ti 

where (x, y) = x T K~ 1 y, and the superscript T indicates matrix transposition. Suppose that 
the vector field V can be decomposed as 

V{ e ) = ~KV e V( e )+A{g), with (KV e V,A) = 0, (102) 

and let g be a minimum of V, with V(g) = 0. This decomposition separates dissipative 
contributions to T> from non-dissipative ones, and is considered in diffusion processes 
described by finite dimensional Langevin equations [161]. Integrating by parts, the "entropy" 
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functional can be written as 




whose last term has no variation. Hence, two kinds of evolution are possible for g: the 
relaxations converging to g, which minimize (11031) and obey (l99l) . and the fluctuations away 
from g, which minimize (11041) . i.e. 



The qualitative properties of the deterministic dynamics do not depend on A, as the time 
derivative of the Lyapunov function V does not depend on A: 



Thus, taking Qi = Q, Qf = p in ( j!04p . one finds that A does not contribute to the "entropy" 
production, while the asymmetry between normal and adjoint dynamics, which implies the 
macroscopic irreversibility, depends on this non-dissipative term. It turns out that one 
peculiarity of the nonequilibrium Lorentz gas of Ref. [157] is that A tends to zero when the 
number of particles grows, which explains the absence of temporal asymmetries in Ref. [157]. 
This is due to the fact that the particles don't interact with each other and that the dynamics 
is chaotic [158,159]. Because that is a rather special situation, temporal asymmetries should 
be common in nonequilibrium systems [158-160]. 

Thus, the separation of a reversible part from an irreversible process, which was part 
of the "pseudo-thermostatic" theories, like Thomson's theory of thermoelectricity, and was 
considered rather artificial in the past (cf. [162] pp. 3,4), results particularly revealing in the 
present context. 

Note that, because there is no "natural" concept of FRP in deterministic dynamics, 
several notions of FRPs have been proposed in Refs. [157-160]. 

9. Numerical and experimental tests 

The FR for nonequilibrium systems was proposed and numerically verified by Evans, Cohen 
and Morris in Ref. [29], where Q = A. After this seminal paper, several numerical tests have 
been devoted to the A-FR, in order to understand how properly do the Chaotic Hypothesis 
and the A-FR describe models of physical systems, as, in general, they do not enjoy the 
Anosov property [47,49,57,60,61,63,67,126,130,131]. Most tests concern, instead, the Q- 
FR, or functions related to the dissipated energy, both in transient and steady states, e.g. 
Refs. [30,31,47,49,56,57,66,84,130,131,163,164]. Let us consider some of these works. 

Lepri, Livi and Politi considered the nonequilibrium FPU chain [66], in which the first 
and last oscillators are coupled to Nose-Hoover thermostats at different temperatures Tl and 



Q=- 



V*(g) = ~KV e V + A(g) 



V + 2A. 



(105) 



V(Q) = V ff V (f?) ■£>(<?)- \{KV Q V (g) , KV e V (g)) < . 



(106) 
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Tr, and the energy fluxes at the left and right ends of the chain, ji and ]r, are given by 



where (Cl,r) is the mean value of the corresponding effective momentum of the thermostat. 
Sinceji = —ju = j in the stationary state, Eq. fl 107ft yields 



which is equivalent to the global entropy production, as obtained from linear response. For 
the Nose-Hoover thermostat (( L ) + (( R ) equals (A), but the instantaneous values and the 
PDF of A and j are not equal [135]. Interestingly, the energy flux was found to obey the 



In Ref. [130], the nonequilibrium Ehrenfest wind-tree model is studied. Despite the lack 
of chaos, the wind-tree model, with small external fields and isokinetic Gaussian thermostat, 
has long quasi-steady transients, in which the dynamics looks random and a sort of steady 
state f2-FR holds, although the asymptotic state is a periodic orbit. A similar result is found 
in the polygonal billiards of Ref. [131]. 

In Ref. [126], the modified A-FR, with c given by Eq. (1431) . was found consistent with 
highly dissipative SLLOD systems but, as in Refs. [47,61], a direct test could not be 
performed, because of the scarce statistics of negative fluctuations. However, assuming the 
validity of a simple scaling for the PDFs of the fluctuations, an indirect verification of Eq. (I43p 
was obtained. A direct verification of a modified A-FR is found in Ref. [49], for the GNS 
models of Eq. (l22l . with very few modes but large Reynolds number. The only particle system 
in which an excess of negative Lyapunov exponents has been obtained without suppressing 
the negative fluctuations of A is the low dimensional Nose- Hoover thermostated oscillator of 
Ref. [50] , for which the standard A-FR was verified. 

The extended FR of Van Zon and Cohen [79, 80] has been numerically verified for 
overdamped Langevin particles and other stochastic models, such as the Markov chain and 
the granular fluids of [138]. A verification for other confining potentials and trap motions 
has been obtained in Ref. [137]. Gilbert has studied the Nose- Hoover thermostatted Lorentz 
gas [67], previously considered in [63], in which one particle diffuses in a billiard and is 
subjected to an external uniform electric field and a Nose-Hoover thermostat. Differently 
from the IE case, the Nose-Hoover model has unbounded A. Gilbert found that the 
fluctuations of A follow (up to finite size effects) Eq. (l93l . However, it is not clear which 
class of systems obeys the modified A-FR, since models with Nose-Hoover thermostats, such 
as those of [50, 135], obey the standard FR. 

Among the numerical studies on temporal asymmetries of FRPs, the one of Ref. [165] 
concerns the fluctuations of cross correlation functions, not considered in Refs. [157-160]. 

Experimental tests of FRs pose difficult problems. The first such experiment was 
presented by Ciliberto and Laroche, in 1998 [166], where the temperature fluctuations in 
a fluid undergoing Rayleigh-Benard convection were found to obey a linear law similar to 



3l,r — —\Cl,r)Tl,r , 



(107) 




(108) 



FR. 
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the FR, but with a different slope. A delicate point of Ref . [166] , is that the fluctuations in 
temperature were considered proportional to the fluctuations in entropy production. 

In 2002 Wang et al. experimentally studied the fluctuations of work done on a colloidal 
particle dragged through water by an optical trap, and verified an integrated form of the 
transient f2-FR. This experiment motivated Ref. [79,80]. An experimental verification of the 
steady state f2-FR followed [141]. 

In 2004 Feitosa and Menon studied a mechanically driven inelastic granular gas in a 
fluidized steady state [167]. They considered the power fluctuations in a subvolume of the 
box containing the granular gas. Identifying the entropy production as the quotient between 
the power and the effective temperature, they verified a local version of fi-FR. 

Gamier and Ciliberto, in 2005, studied the fluctuations of the dissipated power of an 
electric dipole, consisting of a resistor connected in parallel with a capacitor, and driven 
out of equilibrium by an electrical current through the circuit [64, 65] . The work and heat 
fluctuations, both related to the fluctuations of the power dissipated by the resistor, were 
considered: the work fluctuations satisfy the f2-FR with high accuracy, while the PDF of 
heat has non-Gaussian tails, and is consistent with the extended FR of Van Zon and Cohen. 

Shang et al. studied the fluctuations of a local entropy production in turbulent thermal 
convection [168]. They considered a cylindrical cell filled with water. The steady state fi-FR 
was confirmed measuring the velocity and temperature fields. 

Tietz et al. measured the entropy production for a single two-level system, a defect 
center in natural Ila-type diamond [169]. Using fluorescence spectroscopy, they studied 
the transitions between "dark" and "bright" states and, following [150], showed that their 
"stochastic entropy production" satisfies a kind of FR. 

In 2006, Douarche et al. studied the steady state and transient work fluctuations of a 
damped harmonic oscillator that is kept out of equilibrium by an external force [170]. They 
considered a torsion pendulum in a cell filled with a solution of water-glycerol, and measured 
optically its torsional motion. A time dependent external torque was applied and controlled 
by an electric current, and the fluctuations of work were studied. The transient FR was 
confirmed for any averaging time. The steady-state version is observed to converge, although 
in a complex fashion that depends on the external driving. Douarche et al. had previously 
experimentally confirmed the Jarzynski and Crooks equalities in the same experimental 
setup [171]. 

Blickle et al. tested the validity of the Jarzynski and Crooks equalities for a colloidal 
particle in a time-dependent nonharmonic potential [172]. Their experiment consisted in an 
aqueous suspension of micrometrical polystyrene beads. Using optical tweezers they drove 
one of the colloidal particles between two equilibrium states and found that the work exerted 
on the particle verifies the Jarzynski and Crooks relations. 

The Jarzynski equality has found applicability in molecular and biophysical experiments, 
because it can be used to estimate the equilibrium free energy out of measurements of 
dissipated work, in nonequilibrium processes. This is particularly useful in systems for 
which no other method to estimate the free energy exists. The Jarzynski Equality was first 
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confirmed in 2002 by Liphardt et al. in measurements of the dissipated work in folding- 
unfolding process of a single molecule of RNA [173]. Collin et al. experimentally confirmed 
the Crooks relation near and far from equilibrium [174], using optical tweezers and measuring 
the dissipative work during the unfolding and refolding of a small RNA molecule. 

A relation which is often mentioned in connection with the Jarzynski and Crooks 
relations is the steady-state equality of Hatano and Sasa [92], which has been verified in [175]. 
For more on experimental verifications of FRs, see Refs. [45, 176, 177]. 

10. Concluding remarks 

A unifying picture of nonequilibrium physics is emerging, thanks to the development of 
theories describing the nonequilibrium fluctuations, whose role appears to be at least as 
fundamental as that of equilibrium fluctuations. There are two kinds of FRs: transient 
and steady state FRs, which are of totally different nature. Besides being interesting for 
conceptual reasons, both kinds of relations are important in the description of small systems, 
such as nanotechnological devices and biological systems. 

The transient FRs connect in a striking fashion equilibrium and nonequilibrium 
properties of physical systems, in that they consider at once the statistical properties of 
equilibrium states and nonequilibrium dynamics. Their predictions describe the statistics of 
ensembles of experiments, are valid under extremely wide conditions, and can be verified by 
a large variety of physical systems. The steady state relations, on the other hand, concern 
the asymptotic statistics generated by a single system evolution, if a steady state is reached. 

Despite the available rigorous derivations of such relations require very restrictive 
conditions, which are hardly met by any system of physical interest, the steady state FRs 
appear to hold for a wide class of systems. Indeed, the analysis of the physical mechanisms 
underlying the validity of these relations explains why they should be verified as widely as 
common thermodynamic relations can. As Section 5 shows, the steady state f2-FR and its 
consequences can be obtained only from time reversibility and from the ^-autocorrelation 
decay. With these ingredients, indeed, the f2-FR is rigorously estabilished [46]. The above 
analysis cannot contradict the theory based on axiom C systems, because it rests on exact 
results Eq. (1631) in particular- but it raises various questions. For instance, the fact that 
the decay of correlations of axiom C systems does not imply the ^-autocorrelation decay 
required by the steady state f2-FR deserves further investigation. Also, in the linear regime 
of Irreversible Thermodynamics, the ^-autocorrelation decay is required for the transport 
coefficients to exist, but the meaning of (1681) far from equilibrium has still to be fully 
understood, although it is consistent with the available data. The analysis based on the 
decay of the ^-autocorrelation leads also to a number of predictions [46], most of which 
have still to be considered in experimental tests, and attributes a lower importance to strong 
chaos than to correlations decay of small sets of observables, which is favoured by the large 
number of degrees of freedom [159,178]. 

The interplay of deterministic and stochastic approaches is also quite useful. For 
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instance, we have seen how the result of Evans, Cohen and Morriss for deterministic 
systems has motivated much research on stochastic processes, while the work by Bertini, De 
Sole, Gabrielli, Jona-Lasinio and Landim has motivated the study of otherwise unexpected 
properties of deterministic systems. 

Having understood the physical mechanisms underlying the validity of the FRs, the 
present theory may be further developed in directions which aim to clarify various open 
questions, which are both of mathematical and physical interest. Among those mentioned 
at the end of Sections 1, 4 and 5, let us recall the decay of correlations with respect to the 
equilibrium and to the steady state measures, the physical relevance of axiom C systems, 
the construction of dynamical systems which rigorously obey (168]) . and the properties of 
different thermostatting mechanisms. The interaction between mathematical and physical 
approaches seems particularly necessary to explore these new lands. 
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